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(57) 



ABSTRACT 



A system for processing data packets in a data packet network 
has at least one input port for receiving data packets, at least 
one output port for sending out data packets, a processor for 
processing packet data, and a packet predictor for predicting 
a future packet based on a received packet, such that at least 
some processing for the predicted packet may be accom- 
plished before the predicted packet actually arrives at the 
system. The system is used in preferred embodiments in 
Internet routers. 

22 Claims, 5 Drawing Sheets 
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As described in the background section of this specifica- 
tion, current art packet processors, operating typically in data 
routers, operate only on packets received to be routed. The 
r^myentorj according to an embodiment of the present inven- 
tion, provides an apparatus and method that enables a proces- 
sor to predict characteristics of a next incoming data packet 
and initiate speculative processing before the actual next 
packet arrives for processing. The method and apparatus of 
the present invention is described in enabling detail below. 

FIG. 1 is block-diagram illustrating components of a typi- 
cal network processing system according to prior-art. A 
packet buffer or queuing system 101 is illustrated in this 
example of prior art as a typical system present in data packet 
processors. Packet buffering system 101 comprises a direc- 
tion logic block 102 adapted for receiving data packets at 
ingress and determining which of a plurality of data queues 
will be selected for holding the packet data prior to process- 
ing. In this example, there are a plurality of logically-illus- 
trated queues 104a, 1046 to 104k. It will be appreciated by 
one with skill in the art of data processors that there typically 
may be more than three queues associated with a data packet 
processor used for data routing on a data network. 

In this example, an incoming data packet labeled Packet 
Info has been entered in queue 104« as indicated by cross- 
hatching. The data actually stored in such a queue can include 
simply packet identifiers and a packet header to be processed, 
or a complete and full data packet. This option is largely . 
design dependant. The set of queues 104a-n has an associated 
buffer control logic 103 that is connected by control path to a 
common access path or line shared by each queue. The 
method of control and communication between buffer logic 
103 and queue set 104a-n is only logically represented in this : 
example. Actual physical links and structures may vary 
according to design. It will be appreciated by the skilled 
artisan that multiple ingress ports may share one set of data 
queues 1 04a-104n and that it is assumed that data packets are 
serially enqueued and dequeued. 

Selection logic 105 is illustrated within packet buffer sys- 
tem 101 and is adapted to manage how processed packets are 
selected to be sent out of queue to egress of the processing 
system after processing is complete. Selection logic 105 is 
illustrated as connected by control path to a common access ■ 
line shared by all of the queues in set 104a-n as was described 
above with reference to direction logic 1 03 . A processing core 
106 is illustrated in this embodiment and is adapted to process 
data packet information while data packets are in the system. 
Processing core 106 is logically connected through selection : 
logic 105 to queue set 104a-n by a control line. 

In typical prior-art processing, packets arrive through 
ingress of the system as illustrated herein by the label Packets 
In, and are buffered in any one of queues comprising set 
104a-K according to direction logic 102. At least a packet : 
identifier including a queue address location identifier labeled 
herein simply Packet ID is made available to processing core 
106. Core 106 processes the packet information according to 
applicable software. It is noted in this prior-art example that 
processing by core 106 cannot begin until an actual data i 
packets or sufficient information of one is enqueued in one of 
queues 104a-n and is identified and registered within the 
system. 

It is known that data traffic over a data-packet-network 
such as the Internet network typically arrives at processors in < 
a series of data bursts. This means that the processing work- 
load over time of core 106 will experience peaks, valleys, and 



perhaps periods of idleness. These periods of low workload 
and idle times are unavoidable in the current art. The goal of 
the present invention is to utilize low workload and idle times 
for speculative data processing on future data packets yet to 

FIG. 2 is a block-diagram illustrating components of a 
novel network processing system according to an embodi- 
ment of the present invention. In this example, a packet buff- 
ering system 201 is provided with a capability of predicting 

3 characteristics of some data packets before they arrive to the 
processing system. System 201 comprises queues 104a-» as 
described with reference to FIG. 1 above. Direction logic 102 
and selection logic 105 are also present in this example as is 
processing core 106, and these elements are analogous to the 

5 components with the same element numbers previously 
described. 

A novel hardware mechanism labeled herein Packet Pre- 
dictor 202 is provided within system 201 and enables predic- 
tion of data packet characteristics before some packets actu- 

3 ally arrive through ingress of the processing system. Data 
packet predictor 202 is a front-end hardware implementation 
that generates speculative packet information for a virtual 
data packet (predicted data packet). A packet prediction may 
be triggered by any one of several events and conditions, such 

5 as detection ofidle processor time. A good time, however, and 
a trigger used in a preferred embodiment is when a real data 
packet is received by the processing system. 

Packet predictor 202 has, in this example, a dedicated 

j memory (MEM) 204 provided therein and adapted to store 
historical data regarding real data packets previously pro- 
cessed within the system and historical data about successful 
instances of predicted data packets within the system, 
wherein the speculative processing results associated with a 

. predicted packet, backed up by a real packet, were correct 
enough to send the real packet out of the system requiring 
little or no processing of the information associated with the 
real packet. MEM 204 can be a flash type MEM, ROM, RAM, 
or any other type of usable memory sufficient in size to hold 

, at least a historical record covering a pre-defined number of 
data packets. 

In a preferred embodiment, MEM 204 stores a revolving 
history record that is updated periodically, whether or not the 
processing was "real" or "virtual". For example, MEM 204 

i may store historical data covering the last 10 data packets 
received, and also the practical result of the last ten data 
packets predicted. In other embodiments the history record 
could cover many more, or fewer data packets, both real and 
virtual. In an alternative embodiment of the invention, MEM 

> 204 may be implemented externally from predictor 202 or 
from buffer system 201, or even externally from the router 
without departing from the spirit and scope of the present 
invention. For example, MEM 204 may be an assigned por- 
tion of existing memory within the processing system such as 

i queue memory or processing core memory. There are many 
possibilities. 

A buffer logic 205 is provided within packet buffering 
system 201 and adapted to control queue-state reporting and 
management of queues 104a-n similarly to buffer logic 103 

I described above with reference to FIG. 1. In this example 
logic 205 is enhanced to manage queue set 104a-n according 
to additional predictive capabilities of the present invention. 
Logically speaking, buffer logic 205 has control connection 
to a shared access line of queue set IMa-n as well as a control 

i and communication connection to packet predictor 202. 
Additionally, there are illustrated connections between buffer 
logic 205 and direction logic 102 and between buffer logic 



